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What Explains Differences in Internation 
al Performance? TIIVISS Researchers 
Continue to Look for Answers 



by Deborah I. Nelson 

The Third International Mathematics and 
Science Study (TIMSS)-1995 and its successor, 
TIMSS-1999, provide researchers, policymak- 
ers, and educators with an unprecedented 
opportunity to explore the possible relation- 
ships between educational policies and stu- 
dent achievement in an international context. 
Due to the amount and complexity of the 
TIMSS data, analyses have proceeded in 
phases, each providing a more detailed and 
sophisticated understanding of these rela- 
tionships. This Brief is the third in the Con- 
sortium for Policy Research in Education's 
(CPRE) series reporting on the policy impli- 
cations of TIMSS data. It summarizes results 
of recently completed TIMSS research that 
explores in greater detail questions raised in 
initial analyses.' 

Earlier analyses of TIMSS data were 
based largely on observed differences 
between instructional variables in the United 
States and in high-achieving TIMSS nations. 
This was a kind of "benchmarking" approach 
in which certain practices were hypothesized 
to increase student achievement. Some of the 
research summarized in this Brief continues 
this earlier work by exploring additional dif- 
ferences between policy and practice in the 
United States and in other TIMSS nations. 
Other studies expand on this work by look- 
ing for instructional variables that might 
explain differences in student achievement 
across a broader range of TIMSS nations. 
Results do not yield simple lessons and may 
thus be frustrating for those who hoped that 
TIMSS might prescribe specific recommenda- 
tions for policy and practice. Recent research 
does, however, continue to raise important 
questions about the relationships between 



policy, practice, and student achievement in 
an international context. The summary pre- 
sented here highlights key issues that emerge 
from this work. 

Curriculum Content and 
Implementation 

In ]Nhy Schools Matter, Schmidt et al. 
(2001) demonstrate significant relationships 
within all TIMSS nations between the content 
of curriculum, its implementation, and stu- 
dent achievement. Central to this relation- 
ship is the time devoted to instruction on spe- 
cific subtopics, especially when the instruc- 
tion reflects demanding expectations for stu- 
dents. This work expands upon earlier research 
that suggested a relationship between the con- 
tent of curriculum and student achievement with- 
in higher performing TIMSS nations. It does so 
by looking across a greater number of TIMSS 
nations and by using more sophisticated 
measures of curriculum and student learn- 
ing.^ According to Schmidt et al. (2001), 
results confirm the powerful effects that 
schools have on student learning and justify 
continuing efforts to improve instruction. 

The study does not identify any single 
instructional variable that accounts for differ- 
ences in student achievement across nations. 
While content standards and textbooks are 
related both to instruction and student 
achievement, their effects vary in complex 
ways among nations. In the United States, for 
example, textbooks are more closely correlat- 
ed to student learning than are standards. 
Textbooks influence teachers' choice of 
subtopics for instruction and the amount of 
time they spend teaching these topics. In 
other countries, standards play a greater role. 
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though their effects are also mediated 
through textbooks.^ 

These results demonstrate the difficulty of 
taking simple policy lessons from TIMSS 
data. In the work reported below, however, 
Schmidt and his colleagues at the U.S. TIMSS 
National Research Center at Michigan State 
University explored implications from TIMSS 
for improvement of standards, textbooks, 
and course offerings in the United States. 

Standards 

Schmidt, Houang, and Cogan (2002) use 
TIMSS data to suggest ways to improve the 
coherence of U.S. mathematics standards. 
According to Schmidt et al. (2002), standards 
are coherent if they are "articulated over time 
as a sequence of topics and performances that 
are logical and reflect, where appropriate, the 
sequential or hierarchical nature of the disci- 
plinary content from which the subject mat- 
ter derives." The study compares composite 
mathematics^ standards of the 20 highest 
achieving TIMSS nations with those of 21 
states and 50 districts in the United States. 
Results indicate that standards in the United 
States are less coherent than the international 
benchmark standards. Schmidt et al. (2002) 
observe that standards in the United States 
seem more like an arbitrarily arranged laun- 
dry list of skills than a logical sequence of 
skills that build on each other. They attribute 
this partially to the fact that standards in the 
United States contain more topics repeated 
across more grades than do standards in 
higher achieving nations. They suggest that 
pressures resulting from political compro- 
mise and shared decision making make 
inclusion a more influential organizing prin- 
ciple than coherence. 

In contrast, standards in the highest 
achieving nations seem to follow a logical 
sequence — what Schmidt et al. (2002) refer 
to as a "three-tier pattern of increasing math- 
ematical complexity." Standards covering 
grades 1 through 4 place emphasis primarily 
on arithmetic, including common and deci- 
mal fractions, rounding, and estimation. The 
second tier, which includes grades 5 and 6, 
appears to serve a transitional function, mov- 
ing away from arithmetic topics and intro- 
ducing more advanced topics such as nega- 
tive numbers, integers, and their properties; 
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percentages; two-dimensional coordinate 
geometry; and geometric transformations. 
Standards covering grades 7 and 8 form the 
third tier that emphasizes number theory, 
algebra, and geometry. 

Textbooks 

As reported above, textbooks have a 
greater effect on instruction in the United 
States than they do in other nations. 
Valverde, Bianchi, Wolfe, Schmidt, and 
Houang (2002) argue that textbooks are 
essential tools for translating standards into 
opportunities to learn in the classroom. In the 
absence of common standards, they may also 
represent a de facto national curriculum in the 
United States. Previous work indicated that 
content coverage in U.S. textbooks is "a mile 
wide and an inch deep" (Schmidt, McKnight, 
& Raizen, 1997). Valverde et al. extend this 
work to look at differences in the structure of 
textbooks and in the types of pedagogical 
activities they model. Results suggest that, 
like standards, textbooks in the United States 
are less focused and coherent than those in 
higher achieving nations. Content in U.S. 
textbooks is often presented in an episodic, 
disjointed manner. Valverde et al. cite Japan, 
Singapore, and Hong Kong as examples of 
countries whose textbooks reflect a greater 
appreciation for the structure of mathematics 
and science as disciplines. They also note 
fewer differences across TIMSS nations in the 
types of classroom activities modeled in text- 
books. Textbooks in most nations model a 
pedagogy based on mastery of specific mate- 
rial or skills. In this sense, Valverde et al. 
argue, few textbooks have changed to reflect 
the emphasis of standards on problem solv- 
ing, reasoning, and communication.® 

Course Offerings 

Cogan, Schmidt, and Wiley (2001) expand 
upon earlier reports of the "splintered" 
nature of the eighth-grade mathematics cur- 
riculum by using TIMSS data to look at cur- 
ricular variation between educational set- 
tings in the United States.® The study finds a 
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"bewildering" array of different curricular 
offerings between schools, between courses, 
and even between classrooms offering simi- 
lar courses in the same school. Exacerbating 
this variation is the fact that course titles 
often do not accurately reflect content being 
covered in class. For example, 30% of stu- 
dents are using textbooks that do not match 
the title of courses in which they are enrolled.^ 
This finding suggests that the mathematics cur- 
riculum may vary even more than it appears 
and raises questions about functional equiva- 
lency between courses. 

Cogan et al. believe that curricular varia- 
tion results in significant disparities between 
schools and classrooms in students' opportu- 
nities to learn. For example, 30% of students 
attend schools that do not offer an algebra 1 
class. This figure is greater for students 
attending rural or urban schools (40%) than it 
is for their suburban counterparts (20%). This 
variation is especially problematic in the con- 
text of standards-based reforms that demand 
higher levels of achievement from all stu- 
dents. Curricular variation, or "tracking," is 
commonly justified in the United States as a 
means of matching students' abilities and 
interests with appropriate courses. Cogan et 
al. contend, however, that this argument is 
undermined by the seemingly random pat- 
tern of curricular offerings across schools. 

The study also offers additional evidence 
of the need to improve the rigor of mathe- 
matics curricula in the United States; 57% of 
eighth-grade students are enrolled in "regu- 
lar" math classes that rank low on a TIMSS- 
derived scale of topic difficulty. Cogan et al. 
note that efforts to improve coherence and 
rigor at the eighth-grade level must encom- 
pass all prior grades as differences in oppor- 
tunity to learn at the eighth-grade level likely 
reflect differences in all prior years of school- 
ing. 

Classroom Instruction 

The TlMSS-1999 Video Study suggests 
ways to think about the improvement of 
classroom instruction in an international con- 
text. Data for the study are taken primarily 
from videotaped lessons sampled from 
eighth-grade classrooms in the United States 
and six higher achieving TIMSS nations: Aus- 
tralia, the Czech Republic, Hong Kong, 



Japan, the Netherlands, and Switzerland. 
Researchers Ron Gallimore and James Stigler, 
both of the University of California at Fos 
Angeles, and James Hiebert of the University 
of Delaware, focus on characterizing the con- 
tent, form, and pedagogical style of mathe- 
matics and science lessons. The study 
expands upon the TlMSS-1995 videotape 
study by looking at more nations and by 
exploring themes and questions in greater 
depth. Results reported here are from the first 
phase of analysis focused on mathematics 
lessons (Hiebert et al., 2003).® 

Results indicate that the lesson character- 
istics studied do not, in themselves, account 
for differences in student achievement as 
measured by TIMSS. However, the study 
reports a number of similarities and differ- 
ences among lessons in the seven nations.® 
These can be used as analytic tools by those 
seeking to reflect on and improve instruction 
in an international context. It is important to 
note, however, that none of the lesson charac- 
teristics reported here are linked directly 
with student achievement in this study. 

The study reports a number of differences 
between classroom instruction in the United 
States and in most of the higher achieving 
nations. For example, teachers in the United 
States spend more than twice the amount of 
time reviewing content than do teachers in 
the highest achieving nations sampled — 
Japan and Hong Kong.'“ Teachers in the Unit- 
ed States are also more than five times as like- 
ly to spend entire lessons reviewing content 
than teachers in Japan and Hong Kong who 
devote more lesson time to introduction and 
practice of new content. The study also 
reports one especially marked difference 
between pedagogical practice in the United 
States and the highest achieving nations: 
lessons in the United States are much less 
likely to focus on making connections among 
mathematical facts, procedures, and con- 
cepts. Fess than 1% of mathematical prob- 
lems used in U.S. lessons are discussed in a 
way that emphasizes these connections. Dis- 
cussion of problems that emphasize connec- 
tions is a more regular feature of lessons in 
the highest achieving nations, especially 
Japan." 
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The study reports several additional ways 
in which Japanese mathematics lessons are 
different from those in the six other nations.'^ 
These differences concern the nature of math- 
ematical problems used in Japanese class- 
rooms and the way these problems are orga- 
nized within lessons. Japanese lessons con- 
tain a greater number of problems that 
researchers consider to be high in procedural 
complexity — defined as the number of steps 
it takes to solve a problem. The vast majority 
of problems used in lessons by the other six 
nations are considered to be low in procedur- 
al complexity. In Japan, 84% of problems 
used in lessons are of high or moderate com- 
plexity. As mentioned above, more lesson 
problems in Japan are devoted to making 
mathematical connections than are problems 
in other nations (54% of problem statements 
— more than three times as much as most 
other nations). In all the other nations, more 
problems are designed to use procedures 
than they are to make connections or state 
concepts. In Japan, problems are often pre- 
sented based on their mathematical relation- 
ships to each other (42% of problems). The 
majority of problems in other nations are pre- 
sented as repetitions of previous problems (at 
least 65%), compared to only 40% in Japan. 

In addition to these differences, researchers 
also note a number of similarities in lessons 
across nations. These include a focus on solv- 
ing mathematical problems, use of textbooks 
or worksheets to guide lessons, a tendency 
for teachers to speak much more than stu- 
dents (a ratio of 8:1 words), a combination of 
whole-group and private activity (mostly 
individual rather than pairs or groups), and a 
general focus on three topics within the 
eighth-grade curriculum: numbers, geome- 
try, and algebra (combined, these topics rep- 
resent 82% of problems per lesson, on aver- 
age).'® 

Educating Disadvantaged 
Students 

Baker, Goesling, and LeTendre (2002) 
report that while the overall quality of 
schooling in wealthy and less-wealthy 
nations alike has improved over the last 30 
years, family socio-economic status is play- 
ing an even greater role in influencing educa- 
tional outcomes than it has in the past. Baker 
et al. suggest that effective education of dis- 



advantaged students is critical if the United 
States hopes to educate all children to be 
competitive in an international context. 

Some TIMSS data suggest that the United 
States may not be doing as well as many 
other nations in the education of socio-eco- 
nomically disadvantaged children. Baker et 
al. find that disadvantaged students in the 
United States achieve at significantly lower 
levels than similarly disadvantaged students 
in other developed, wealthy nations sampled 
in TIMSS. Baker et al. suggest that improving 
the education of disadvantaged students 
would do much to improve the overall stand- 
ing of the United States in TIMSS mathemat- 
ics achievement. For example, if the United 
States educated disadvantaged children as 
well as Sweden does, it would score above 
five wealthy nations it currently performs 
below. 

Several studies suggest factors that con- 
tribute to the less effective education of dis- 
advantaged students in the United States. 
Baker et al. report that schools serving disad- 
vantaged students in the United States tend 
to exist in systems of greater inequality and 
have lower absolute levels of instructional 
resources than do schools serving disadvan- 
taged students in other nations. As reported 
above, Cogan et al. note that students in rural 
and urban schools have less access to higher- 
level mathematics courses than do their sub- 
urban counterparts. Further, students in 
urban schools with high numbers of minori- 
ty students are more likely to be in classes 
focused on arithmetic than students in low- 
minority suburban schools. These differences 
in opportunities to learn may have conse- 
quences that go beyond achievement. Akiba, 
LeTendre, Baker, and Goesling (2002) use 
TIMSS data to suggest that nations produc- 
ing greater achievement differences between 
high- and low-achieving students also report 
more school violence. 

No Simple Solutions 

Much of the TIMSS research conducted 
over the last five years attempted to find 
cross-national relationships between specific 
instructional variables and student achieve- 
ment. Few clear relationships emerged from 
this work. Among the hundreds of policy- 
and practice-related variables examined at 
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Pennsylvania State University and the Center 
for Research and Evaluation in Social Policy 
(CRESP) at the University of Pennsylvania, 
several did indicate positive relationships 
with student achievement. These relation- 
ships are difficult to translate into direct 
implications for policy and practice.'^ There 
are, however, positive lessons to be learned 
from the absence of simple, cross-national 
relationships, both about understanding the 
complex nature of educational systems and 
about the challenges of conducting analyses 
of international comparative data. 

According to Baker (2002), whose 
research team at Penn State has conducted a 
series of TIMSS analyses, the absence of sim- 
ple cross-national relationships should send a 
clear message about avoiding the kinds of 
policy prescriptions that are often associated 
with international comparative data. Their 
research, for example, challenges a number of 
commonly held assumptions about the nega- 
tive characteristics of American high schools 
in comparison to their international counter- 
parts on such factors as school violence, 
learning climate, and students' lack of moti- 
vation or attention to school work (Baker, 
2002). Baker cautions against policies based 
on simplistic interpretations of international 
data, suggesting instead that "it may take a 
whole case of silver bullets to make real 
changes in the international competitiveness 
of American secondary education." Rather 
than looking for easy answers, policymakers 
must seek to understand the important rela- 
tionships among curriculum, accoimtability, 
distribution of resources, and other sources 
of influence on student achievement. 

Schmidt et al. (2001) believe that while 
TIMSS data provide an important framework 
for reform, they carmot yield specific, gener- 
alizable policy solutions. They caution, "We 
cannot copy a single aspect of curriculum or 
any other part of education from another 
country. Those are part of national systems 
and there is not enough data in TIMSS to be 
able to account for all the different factors." 
Using TIMSS as a framework, they believe 
that policymakers must instead craft solu- 
tions from analysis of additional data related 
to student achievement, curriculum, and 
implementation in local contexts.'® 



Using TIMSS to Craft Local 
Solutions 

The St. Clair County Promoting Results in 
Science and Math (PRISM) initiative provides 
an example of how TIMSS instruments can be 
used to collect the kind of data useful in craft- 
ing specific reforms at the local level 
(Schmidt et al., 2002). The initiative brings 
together researchers from the U.S. TIMSS 
National Research Center at Michigan State 
University and seven districts that are com- 
mitted to using TlMSS-derived data to look 
at relationships between curriculum and 
learning. These districts administered TIMSS 
assessments across a greater number of 
grades than are tested in TIMSS.'® In addi- 
tion, students, teachers, administrators, and 
curriculum directors completed question- 
naires yielding extensive data about curricu- 
lum coverage of specific subtopics. These 
data permit districts to make broad compar- 
isons between their districts, the United 
States, and 40 other countries on measures of 
student achievement and curriculum. Unlike 
TIMSS, they also yield information about stu- 
dent achievement and curriculum coverage 
at the classroom, school, and district levels. 
Especially helpful for these districts were 
analyses suggesting relationships between 
student achievement and curriculum cover- 
age of specific subtopics. 

Results indicated similarities between the 
St. Clair districts and the United States in 
general on both student achievement and 
curriculum content. These results reinforced 
existing research suggesting the need for states 
and districts to improve the rigor and coher- 
ence of standards and curriculum. The speci- 
ficity of the data allowed district administra- 
tors and teachers to observe more direct rela- 
tionships between coverage of content and 
learning than is possible with the national- 
level TIMSS data. PRISM data have provided 
the base for district-sponsored professional 
development in which teachers and adminis- 
trators conduct close analyses of content cov- 
erage and student achievement at all levels.'^ 
As a result of this process, the districts are 
working together to develop common stan- 
dards that address problems uncovered in 
their data. 
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Methodological Issues Associated with Analyzing 
International Comparative Data 

Researchers' experiences with TIMSS have yielded a number of lessons about the challenges involved in 
designing international comparative studies and analyzing their data. 

Differentiating Cumulative Achievement and Growth 

A number of researchers have highlighted problems associated with looking for relationships between 
cumulative achievement measures, such as the TIMSS eighth-grade achievement score, and other variables, 
such as curriculum or instruction, that are grade specific. The cumulative achievement measures reflect stu- 
dents' learning over many years of schooling, not just in the grade assessed. More precise measures are nec- 
essary to link student achievement with instructional variables. Growth scores that reflect students' learning 
in a specific grade are more likely to interact with curriculum and instruction variables for that grade. (As 
described earlier, Schmidt et al. [2001] use measures that capture achievement growth over eighth grade in 
specific subtopics. Curriculum indicators are also specified by subtopic.) Schmidt et al. (2001) point out that 
the cumulative measures are helpful as a "yardstick" to compare achievement among nations. But growth 
measures are more valuable for those who hope to use international comparative research as a kind of "labo- 
ratory" of different approaches to policy and practice. 



Understanding Contextual Relationships 

Relationships between educational variables and student achievement at one level of analysis — for exam- 
ple, the national — often do not hold up at other levels, such as the school or student. Results must always be 
interpreted with caution when they are taken out of context. A number of researchers have found, for exam- 
ple, that variables predicting student achievement within particular countries do not hold up in cross-nation- 
al analyses. The virtual absence of cross-national educational variables predicting student achievement sug- 
gests that educational policies and instructional practices are difficult to separate from the contexts in which 
they are developed and implemented. Schmidt et al. (2001) note that, even with the extensive data it provides, 
TIMSS cannot explain the way something complex, like curriculum, works across countries. TIMSS can be 
used to get a broad sense of the kinds of relationships that exist, but qualitative studies are necessary to under- 
stand the nature of those relationships within particular countries. 

Understanding Others, Educating Ourselves, a National Research Council report released by the Board on 
International Comparative Studies in Education at the National Academy of Sciences, notes that false expec- 
tations are raised by those who suggest that isolated practices can be easily transferred between different edu- 
cational systems. It recommends that the United States take a more systematic approach to exploring interna- 
tional differences in policy and practice by balancing large-scale comparative assessments with more inter- 
pretive studies. This approach would require long-term funding commitments to support continuing research 
as well as the infrastructure and leadership necessary to coordinate a research agenda. 



Interpreting Achievement Scores 

Context may also affect the relationship between what students know and what they demonstrate on 
achievement tests. For example, Boe, May, Shin, and Boruch (2002) demonstrate that more than half of the vari- 
ability in national mean achievement scores can be accounted for by "student task persistence." This measure, 
derived from the TIMSS student questionnaire, shows that students vary greatly among countries in the 
degree to which they apply themselves in test taking. 
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Conclusion 

Recent analyses of TIMSS data continue 
to raise important issues for improvement of 
mathematics and science instruction. They 
also provide guidance about how future 
efforts at international data collection and 
analysis might clarify differences in policy 
and practice and their links with student 
achievement. Finally, the TIMSS experience 
highlights an important lesson for all those 
who hope to use international comparative 
data for improvement at the national and 
local levels. These data can provide critical 
tools for shaping reform agendas, but they 
must always be interpreted with caution and 
with rigorous and thoughtful attention to 
contextual factors that affect educational 
policies and outcomes. 
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End Notes 

1. See Dunson (2000) and Nelson (2002) 
for details about the nature of TIMSS data 
and prior analyses. 

2. Specifically, the study explores relation- 
ships between intended curriculum (as mea- 
sured by content standards and proportion of 
textbook space focused on specific topics), 
implemented curriculum (teacher time and 
focus on topics), and estimated national gains 
in tested areas at the eighth-grade level. This 
study uses more precise measures of curricu- 
lum and achievement than have been used 
with TIMSS analyses in the past. It distin- 
guishes between "intended" curriculum (as 
measured by curriculum standards and text- 
book coverage of specific subtopics) and 
"implemented" curriculum (as measured by 
the topics teachers emphasize and how much 
time they spend on them). As an achievement 
measure, the study looks at eighth-grade 
gains, computed from differences in seventh- 
and eighth-grade scores, rather than looking 
at just eighth-grade scores. Schmidt et al. 
(2001) believe that the gain scores are more 



closely related to eighth-grade curriculum 
measures than the eighth-grade scores which 
reflect all prior school experiences. Ranked 
according to the eighth-grade achievement 
gain measure, the United States did worse 
than its rank by eighth-grade mean scores, 
scoring lower than all but four countries in 
mathematics and three in science. 

3. Schmidt et al. (2001) speculate that the 
varying effects of standards may be related to 
differences in governance among nations. In 
the United States, decentralized governance 
makes it difficult to implement standards 
consistently across jurisdictions. 

4. Additional work available from the U.S. 
TIMSS Research Center at Michigan State 
University does a similar comparison with 
science standards. 

5. Valverde et al. (2002) note that in many 
nations this deficiency in textbooks may be 
compensated by strengths in other policy 
instruments such as teacher training prac- 
tices or national examinations. They suggest 
that deficient textbooks are more harmful in 
countries like the United States that lack 
alternative methods of influencing the imple- 
mentation of curriculum on a national level. 

6. Their analysis is based on the type and 
number of different courses available in dif- 
ferent schools, the percentage of students 
enrolled in those courses, textbooks used, 
and the amount of time teachers spent on dif- 
ferent topics within those courses. Courses 
were categorized by researchers as remedial, 
regular, enriched, prealgebra, algebra I, and 
geometry, based on topics covered. 

7. If courses are characterized by textbook 
rather than course title, then the percentage 
of U.S. eighth-grade students studying alge- 
bra (14%) is even less than reported else- 
where. 

8. Video clips from this report are avail- 
able on CD-ROM from the National Center 
on Education Statistics or online at 
http: / / nces.ed.gov/pubs2003/ 
timssvideo. 

9. A number of these differences are high- 
lighted here. For a more comprehensive 
description, see Hiebert et al. (2003). 



7 



Policy Briefs 



10. There is no evidence to suggest that 
this difference or any of the variations report- 
ed here account for differences in student 
achievement. For example, in the Czech 
Republic, which also scored higher than the 
United States, lessons devote even more time 
to review of content. 

11. Other nations varied widely on this 
measure, but the difference is especially 
marked in the case of the United States. 

12. Japanese lessons are of interest as they 
are distinct from those in other sampled 
nations and because Japanese students have 
demonstrated consistently high achievement 
on TIMSS tests. There is, however, no evi- 
dence to suggest that the differences reported 
here account for the high achievement of 
Japanese students. For example, lessons in 
Hong Kong, which ranked slightly higher 
than Japan on the TlMSS-1999 mathematics 
assessment, do not share these characteris- 
tics. 

13. This figure represents the average 
across all lessons; no single lesson is likely to 
show a combination of all topics. 

14. Research conducted at CRESP using 
cross-national multivariate prediction mod- 
els for student achievement, for example, 
found three variables that together accounted 
for 84% of the total cross-national variability 
in mathematics achievement. These predictor 
variables, all inversely related to achieve- 
ment, were: (1) the national percentage of 
students who strongly agreed that they usu- 
ally do well in math, (2) the national percent- 
age of students who strongly agreed that to 
do well in math they need good luck, and (3) 
the national percentage of students who 
strongly agreed that their mother thought it 
was important for them to be good at sports. 
In science, four national-level predictor vari- 
ables accounted for 85% of the total variabili- 
ty among nations in science achievement. 
They were: (1) the school provides special sci- 
ence enrichment activities (positive relation- 
ship with achievement), (2) the fact that a 
school's capacity to provide instruction was 
affected "a lot" by a shortage or inadequacy 
of science laboratory equipment and materi- 
als (inverse relationship with achievement), 
(3) the hours students work on paid jobs per 
week (inverse relationship with achieve- 



ment), and (4) the national percentage of stu- 
dents who strongly agreed that to do well in 
science they need good luck (inverse rela- 
tionship with achievement). 

15. See Nelson (2002) for a summary of 
how some TIMSS benchmarking jurisdictions 
are approaching this challenge. 

16. TIMSS student assessments were 
given at grades 3 and 4 (TIMSS fourth- 
grade assessment), 7 and 8 (TIMSS eighth- 
grade assessment), and 12 (TIMSS end-of- 
secondary-school assessment). In addition, 
the TIMSS eighth-grade assessment was 
administered in grades 9-12 to yield data on 
achievement growth across grades in spe- 
cific subtopics. 

17. To learn more about this work, con- 
tact Cynthia Banach, Assistant Superinten- 
dent, St. Clair Intermediate School District at 
(810) 364-8990. 
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